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Purpose 

OBRA requirements, as outline by HCFA, require all nurse aides working in 
nursing facilities, to successfully complete a written and skill evaluation, 
approved by the Iowa Department of Inspections and Appeals. The persons 
conducting the skill evaluation must have completed a training program. This 
workshop is designed to prepare these evaluators. 

Evaluator Oualif Lcations 

Evaluators must meet the same qualifications as teachers. They must be a 
registered nurse, had a minimum of two years work experience with either 
geriatric residents or chronically ill patients, and must have completed an 
approved evaluator training program. 

Workshop Objectives 

Upon successful completion of this workshop participants should be able to 
prepare nurse aide evaluators to do the following: 

* Describe the procedures for conducting nurse aide evaluations and methods 
to share those procedures with evaluators. 

* Discuss the principles associated with valid, reliable evaluations, 
that allow decision makers to make accurate decisions. 

* Review the skills checklists associated with the approved curriculum 
and describe how they will be used to evaluate nurse aides. 

* Demonstrate the ability to objectively observe a nurse aide during a 
skills competency test and make appropriate decisions regarding nurse 
aide performance. 

* Review the criteria for successful completion and accurately assign a 
weight to nurse aide performance on the skill checklist. 







Upon successful completion of the workshop participants will be awarded a 
certificate from the Area College. 
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Introduction to Evaluation for Career Education Programs 

Following are some general terms and information about testing that are not 
included in your text. 

General Terms Defined 

Measurement - a systematic process of gathering quantitative information 
to describe students* performance or behavior. This can be compared with 
evaluation, which assigns a value or worth for the measured behavior. 

Test - Generally an instrument carefully designed for gathering specific 
information or measuring well-defined performances of people. Tests can 
be oral, performance or written, and can measure knowledge, performance 
and attitudes. 



Evaluation - The total process of gathering the necessary information, 
assigning a value or worth to the information and using this information 
to made decisions, e.g., students* performance is acceptable, the 
teaching methods need changing, etc. It is concerned with effectiveness 
versus ineffectiveness, valuable versus invaluable, appropriate versus 
inappropriate. In educational programs it includes objectives, means of 
obtaining objectives, output or students* behaviors. 

There are three terms that describe information obtained in measurement. 



Formative Measurement - These are measurements (tests) to obtain 
diagnostic information about students* performances. The information is 
then used in 11 formulating, " revising instructional objectives, content 
and methods. Pre-tests, quizzes are examples. 



Summative Measurement - These measurements (tests) follow a systematic 
instructional sequence and provide information regarding how well 
objectives were met. The measurements are more conclusive in nature and 
help teachers make decisions about student readiness or effectiveness of 
objectives, and methods that were used in the process. Examples are unit 
tests, final exams, etc. 

Ultimate Measurement - These measurements are the most valuable, but most 
difficult to obtain. They provide information about the relationship 
between what students are taught and its relevancy to what they must do 
on-the-job. An example is a follow-up study. 

Measurement/testing has several functions in education. These functions 

require various types of measuring instruments (tests). 
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Achievement Tests . An integral part of the teaching- learning process 
that measures classroom/performance achievement. Genera l achievement 
tests sample all the knowledge, skills and attitudes that are a part of a 
particular occupation or subject. Diagnostic achieve ment tests, identify 
strengths and weaknesses in a given unit of instruction. performance . 
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achievement tests require the student to perform a sample of the 
work/skill required to meet the objectives. Achievement test items are 
based on program goals or objectives. The emphasis in this course is on 
developing and assessing teacher-made achievement tests. 

General Mental Ability Tests . Tests that gather information or measure 
those mental abilities that are valuable in almost any type of thinking. 
These tests are sometimes called intelligence tests. They are designed 
to measure performance as well as verbal skills. General mental ability 
tests can be given to individuals or to groups ( Lor ge- Thorndike ) . If 
needed, general mental ability tests are usually purchased from a 
publisher and administered by student personnel. 

Aptitude Tests . Tests that are concerned with measuring a specific 
mental ability that is important in some particular occupation. They 
provide information about student's current capabilities. The informa- 
tion can assist in predicting success in a given program. 

Interest Inventories . Tests that provide information about^student's 
level of interest in a given field. They provide information for career 
guidance . 

Attitude Tests . These tests are similar to interest inventories. They 
provide information on how students like to learn, how they feel about 
program tasks or work in general. 



Reference Points for Measurement . A teacher can use two general points of 
reference when considering a student's score on a test. These points are 
norm- referenced and criterion-referenced. 

Horm^referenced measures - when the score tells where the person stands 
in some population of persons who have taken the test. The main 
objective of norm- referencing is to discriminate, e.g., separate students 
with regard to class achievement, so comparisons and judgements can be 
made based on these comparisons (see attachment) . 

Criterion- referenced measurements - when the score gives information that 
describes how well a student has met a specified standard of performance. 
The score describes the student's performance related to clearly defined 
criteria not relative to other students (see handouts) . 

There are two other general distinctions that need to be made about tests. 
These refer to standardized and standardization. 

Standardized . A standardized test is one in which the procedure, 
apparatus and scoring so that the exact same testing procedure can be 
followed at all times and an any place. Every condition that affects 
test performance must be specified. 

Standardization . The process of gathering norm data bout a test to 
provide a reference point for individual scores. The "norm” group 
selected, as well as, standardized procedures, are critical to the 
interpretation of scores. 
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SUGGESTIONS FOR EVALUATING STUDENT CLINICAL PERFORMANCE 



In nearly every educational setting, instructors must evaluate student 
competence. Written tests that require the student to select the best answer 
to a question from among several alternative choices (or to prepare answers to 
broad questions) are used widely in higher education. The standardized format, 
ease of scoring, and well-researched psychometric properties of some of these 
evaluation techniques have contributed to their popularity. However, if the 
instructor is interested in observing the actual application of principles 
and concepts presented in the classroom, a paper and pencil test may not be 
the most appropriate measure of student learning. There are many settings 
in which performance measures, rather than written tests, will be more valid. 

The clinical performance of students in health education professions is one 
such setting. This paper will present guidelines for the development and use 
of three techniques which are useful in evaluating student achievement in 
clinical settings: (1) the rating scale, (2) the checklist, and (3) the 

anecdotal record. 

The major purpose of this bulletin is to discuss the application of some 
general psychometric principles to settings in which (1) students are expected 
to interact as individuals with "patients" or "clients"; and (2) sound evalua- 
tions of student achievement can logically be derived, at least in part, from 
the observation of students in these "real-life" circumstances • We will wak e 
some specific suggestions concerning the settings in which performance evalua- 
tions appear appropriate and/or desirable, the nature of the instruments used 
to record observations about student performance, and the ways in which such 
information should and can be used effectively. Our e xa mples will be primarily 
drawn from medical, dental and nursing education; the ideas are more widely 
applicable than our examples may suggest (e.g., counseling, social work, student 
teaching) . 
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At the outset, we should describe the learning activities which comprise 
a "clinical" setting. First, It Is essential that each student* whose 
achievement Is to be evaluated Is engaged In one-to-one Interaction with 
a patient or client requiring the studentto Integrate prior knowledge In 
order to respond appropriately to the patient or to complete some specific 
task. The setting, as described above, clearly eliminates such efficient 
evaluation procedures as group (or simultaneous) assessment of all students 
by the instructor. Since group tests present all students with Identical 
tasks and standardize most essential conditions of the evaluation, many of 
the suggestions which follow are attempts to Instill some measure of stan- 
dardization in the clinical evaluation process. The other common feature of . 
clinical settings Is that certain psychomotor and/or affective (attitude, 
values, etc.) learning outcomes must be evaluated simultaneously with the 
student's cognitive (thinking) processes. Since it is difficult to construct 
written examinations for such outcomes, it will be more expedient to watch 
the student perform the relevant activities In the clinic or In a simulated 
clinic setting, and evaluate that performance. 

Unfortunately, thoroughly developed and tested methods will probably 
not become available for wide-spread use In clinical evaluation (as has 
happened In certain content areas evaluated by standardized written tests) . 
Rather, it seems likely that each course or learning experience will require 
a unique ins trument and set of administrative procedures. Fortunately, it 
Is not difficult to conduct sound cl ini cal evaluations, nor does It usually 
require any particular expertise inr statistical methods or psychometric 
theory. This paper is Intended to provide assistance for persons engaged 
in developing such Instruments and procedures. 
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TWO IMPORTANT CONCEPTS: RELIABILITY AND VALIDITY 

So that the reader will understand the rationale for the suggestions In 
this bulletin and so that solutions to problems not discussed here can be 
developed. It seems useful to begin with two Important concepts from the field 
of educational measurement: reliability and validity. 

The first of these, RELIABILITY, refers to the consistency with which a 
particular evaluation method measures whatever It measures. A reliable 
procedure Is one in which the results represent stable or trustworthy assess- 
ments of something. For written tests, the reliability of the test score (s) 

Is usually est ima ted by comparing the scores earned by a group of students on 
two logically equivalent sets of test questions. A set of test scores is 
reliable to the extent that the two scores for each student are similar. Essay 
avgrryf n a t~ -f nna are graded reliably if two competent readers, acting Independently, 
assign grades which are Identical or similar for each paper . Similarly , clini- 
cal evaluations are reliable to the extent that competent Judges, acting Inde- 
pendently, would agree about the level of achievement for each student. In 
general, any decision made about the setting In which the students are observed 
or about the Ins tr ument used to record the observations which seems likely to 
result In better agreement among competent judges is likely to improve the 
reliability of the evaluations . If two or more judges are used, the reliability 
of the evaluations can be directly estimated and expressed as a correlation- 
type Index. If only one set of judgments is available, the case for adequate 
reliability must be made on a logical basis. 

VALIDITY, on the other hand, is the degree to which the evaluation 
procedures produce Information In the INTENDED aspects of the students achieve- 
ment. As such, it is a characteristic less subject to quantification than is 
reliability, and the assessment of the validity of an evaluation procedure must 
rest heavily on a logical analysis of the procedure. 
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A valid instrument is one that is freedfrom systematic bias. Every 
student must have a fair opportunity to perform the behaviors that are being 
observed. If this is not so, then the procedure is invalid. The validity 
of the measurement also depends on the extent to which professionals in the 
field agree that the behaviors being observed and evaluated are critical to 
successful professional practice. The behaviors should also be consistent 
with the instruction that the student has been exposed to before entry to the 
clinical setting. Careful consideration should be given to these qualifies 
as the clinical evaluation instrument is being developed. 

CREATING A GOOD SETTING FOR CLINICAL EVALUATION 

Regardless of which type of clinical evaluation instrument will be used, 
there are Important elements of the setting which should be considered before 
the instrument is developed. Each of these has a major influence on the 
reliability and validity of the evaluations . 

Who will be observing the students? 

Clinical evaluation instruments require one or more observers to record 
information about student performance. It is important to seek an appro- 
priate balance between the amount of time required to observe a typical 
performance by each student, and the amount of time the observers have 
available to watch that performance. For example, a long and detailed list 
of procedures to be accomplished by the student can not yield very reliable 
results if the observer is able to spend only a few minutes with each student. 
If the observers are faculty members with many other responsibilities (or 
responsibility for many students) in the clinical setting, brief forms that 
can be quickly completed are preferred. In such a situation, it may be 
necessary to have three or four persons observing different aspects of the 
student's performance in order to arrive at a valid composite evaluation. 
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It is also important to consider the nature of the contact the observer 




will have with the student. Observers are rarely able to simply watch the 
student and evaluate the performance. More typically, the observer will be 
involved with other duties while the student is working. This may directly 
affect the validity of the evaluations. For examp le, if a dentist works in 
an office area that is separate from the area where a dental auxiliary student 
works, the dentist may be unable to observe many aspects of the student's 
performance and be una ble to provide valid observations. Before asking persons 
to complete clinical evaluations instruments, consider carefully which aspects 
of the student's performance they will have been able to observe. The general 
guideline here is that people can only validly evaluate those behaviors which 
they have personally and purposefully observed. 

It required some co mmi tment on the part of observers to give reliable 
clinical evaluations. Observers should be asked to assist in developing the 
Instruments and the guidelines for their use. Some additional time should be 
spent training observers in the use of the procedures. It will certainly 
require time and careful thought to observe the student and produce valid 
evaluations. When asking persons to function as observers, be as explicit 
and accurate as possible about the time commitment that will be required. 

Even if the requirements are made explicit, some observers may be unwilling 
or unable to produce valid evaluations. Clues to an uncommitted or inept 
observers generally can be found in a non— discriminating pattern of obser 1- 
vatlons — for example, persons who turn in "line" ratings (e.g., all "3's") 
for nearly all behaviors and students, or those who report all characteristics 
positively or all negatively. These patterns often indicate Inadequate consid- 
eration in evaluating student performance. 

It is also important to consider the degree of expertise required on 
the part of the observer. It may not always be necessary to use professionals 
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for all evaluations. Non-professional observers can often be trained to be 
valid evaluators of complex procedures and even of certain aspects of the 
quality of student work. You should consider the possibility of using 
trained observers who are able to focus much of their energy on the evalua- 
tions for certain types of observations. 

Where will the observations be made? 

A second element to consider as you develop your Instruments is the 
context in which they will be used. If the setting is the actual clinic, 
then the evaluation of student performance may be secondary to the primary 
goal of service. That is, students work with patients in order to help the 
patient, -not to provide samples of their performance. .Likewise, the patients 
who are being treated expect quality care and professional Interactions with 
the health care specialists. In most clinic settings, this means that the 
student is not allowed to proceed In a faulty or dangerous manner and that 
the Instructor (observer) will Intervene to correct faulty procedures as 
soon as they are noted. While this Intervention is certainly necessary to 
Insure proper treatment, the final product can not be taken as an accurate 
sample of the student's achievement. Rather, the adequacy of treatment must 
be evaluated on the basis of the instructor's judgment of what the product 
would have been had the intervention not occurred. This pattern, while 
potentially instructive for the student, does not allow a direct observation 
of the student's independent achievement and may diminish somewhat the 
validity of the evaluation. 

The major advantage of the clinic setting is that it is, reality. The 
elements of this setting are frequently identical to the elements that the 
student will face after completing professional training. There should be 
mflytimnn transfer of learning from this setting to post-graduate professional 
practice. The primary disadvantages stem from the Inability to standardize 



the patient base, since each student works with persons who come to the clinic. 
There may be important dimensions of a student's performance that can never 
be observed because of the particular sample of patients who happened to be 
assigned to that student. Also, because each student works with different 
patients, it is difficult to compare the performance of different students 
because there is no equivalent or standard set of problems faced by all stu- 
dents. Finally, during certain periods, the rate of patient contact may 
vary considerably so that some students may treat twice as many patients as 
others. This difference in "base rate" limits our ability to make evalua- 
tions of equal reliability, since some are based on very few observations. ' 
The disadvantages of the real setting become the advantages of a simu- 
lated, or artifical setting. Here it is possible to control the stimuli 
that confront the student. Using a computer "patient", or a live "progr ammed 
patient allows you to observe the student in a setting where learning and 
evaluation are the primary goals. You can arrange the setting to insure that 
each student confronts a similar or identical set of problems that will elicit 
the behaviors you want to observe. Simulated settings should also be used 
when student errors may be too "costly", or when it is simply not possible 
to make observations in the real-life setting. The artificiality of the 
setting, however, may make it impossible to replicate every element of the 
real setting that may affect student performance. 

As a third strategy, rather than observing a student in either real or 
simulated settings, you can review case plans prepared by the student which 
outline what will be or was done with the client. This approach may be 
appropriate if your primary concern is with the student ' s ability to diagnose 
and prescribe treatment for the patient. A case plan will, of course, not 
provide a direct observation of the student's application of knowledge or 
interpersonal skills in the clinic setting. The advantage of the case plan 
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approach, where it is appropriate, is that observers can review the plan 
whenever they are free. The disadvantage is that you do not view the inter- 
personal aspects of the student.^ s care, nor do you witness the actual enact- 
ment phase of the plan. 

What student behaviors are you interested in? 

The last critical question you should answer, prior to the development 
of any instrument, is what specific kinds of student performance are of 
interest. If you are interested primarily in student knowledge, or cogni- 
tive outcomes, you may use a different set of instruments than if you are 
concerned with the application of that knowledge. Psychomotor skills must 
generally be viewed to be evaluated. On the other hand,. it is almost 
impossible to view affect outcomes directly. For the latter, you must i 
frequently rely on indirect methods to assess how the student feels about 


V..V 


the clinical setting and/or patient. In some cases you may be concerned 
with all three kinds of outcomes. 

Cognitive Outcomes. Students are usually taught principles and concepts in 
the classroom. You would usually use written tests to assess how well they 
understand these fundamentals , but may still need to evaluate the application 
of this learning. Perhaps you are interested in observing how well the 
student can diagnose or manage a typical or problem patient. Perhaps you 
are interested in observing how well the student can explain procedures and 
facts about a disease to a patient. It is often possible to observe these 
aspects of student performance without developing clinical evaluation 
instruments. (Written tests can be developed in many instances.) The 
use of written patient-management problems that permit students to make 
diagnoses, plan treatments and learn the results of their decisions is 
increasing. Likewise, the computerization of such problems extends even 
further the realism that can be provided in what is essentially a written 
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evaluation instrument. It is desirable to use a written form of this type 
whenever it is not essential that you view the actual performance because 
of the much greater standardization which can be accomplished. Every stu- 
dent experiences a standard, pre— specified set of options that simplifies 
problems of evaluation as well as improves the reliability of the examina- 
tion. Admini strative problems are also considerably reduced with written 
exams. Students can generally complete patient man agement problems on their 
own, when they are free — and it is not necessary to locate, train and schedule 
observers. 

Psychomotor Outcomes . If psychomotor outcomes are important , you will 
usually want to arrange for the actual observation and evaluation of student 
performance. As noted previously, you can arrange to have the student inter- 
act with the patient in either a real or simulated setting. Whichever setting 
you choose, you should have at least one qualified person available to observe 
and evaluate the student's skills. The form you use for this purpose may be 
any of the three that will be discussed shortly in more detail — the rating 
scale, the checklist, or the anecdotal record. In addition to (or instead of) 
the on— site observation, you can videotape the student's performance. This 
will permit you to evaluate the student's actions under more leisurely circum- 
stances, and the student to learn by watching his/her own performance. 
Affective Outcomes . The affective outcomes of education are very difficult 
to observe and measure directly. The patient responds to the personal traits 
of the student as much or more, perhaps, than to the cognitive and psycho- 
motor skills. The manner in which a patient is treated certainly affects the 

way in which the service at the clinic is perceived. Less directly, patients' 

/ 

perceptions of the service also are likely to influence their compliance with 
any treatment plans. The measurement of affective qualities, or personal 
traits of the student, presents many problems. Since there are many possible 

16 
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explanations for any single student behavior, you should usually observe many 
behaviors before trying to infer the presence or absence of a personal charac- 
teristic or affective outcome. It may require many raters in order to assure 
adequate reliability. This is one area, however, in which patients can often 
assist in the evaluation. (Patients are not usually able to provide information 
about what the student knows or is able to do, but they can certainly tell you 
how the student made them feel or what kind of an impression was made.) It is 
essential, of course, to establish an objective framework to reduce the possi- 
bility that patients will tell you what they think you* want to hear. You will 
probably want to assure the patients that their responses will be anonymous 
and to emphasize that the student needs accurate information about performance 
in order to learn and improve. 

As Indicated at the beginning of this section, there are many factors to 
be considered before selecting the setting and instrument to use in evaluating 
student learning. From these considerations should emerge a very clear idea 
of the kind of instruments that will be required. 

GUIDELINES FOR DEVELOPING ITEMS FOR CLINICAL EVALUATION INSTRUMENTS 

Three types of items are used in clinical evaluation instruments: (1) the 

rating scale, (2) the checklist, and (3) the anecdotal record. Each will be 
defined and discussed in turn. 

The rating scale is a series of items asking an observer to evaluate stu- 
dent performance or characteristics relative to scaled behavior or numerical 
categories. The items on the rating scale generally cover a broad range of 
student characteristics, and permit the observer to make judgments about the 
quality or quantity of the behavior that is being observed. A sample item from 
a rating scale is given on the following page. 



characteristic- 



2 . 



To what extent does the student demonstrate 
interest in becoming a well-qualified oncologist? 
Evidence of interest could include: (1) Attendance 

at required or optional cancer teaching sessions; 
(2) time spent in patient care; and (3) reading 





and : 


studying materials in 


the Cancer 


Corner . 




numerical 


-^1 


2 


3 


4 


5 


0 


scale 
















Does not 


Does 


Exceeds 


Exceeds 


Superior 


No 


behavior - - 


— ^ meet re- 


required 


required 


required 


performance 


ob- 


categories 


quired 


work 


standards 


standards 


in all 


ser- 




standards 


only. 


in one 


in two of 


three 


va- 




in any of 




area. 


the three 


areas . 


tion 




the three 






areas. 








areas . 














It Is appropriate to use a rating scale when you want to make global 
evaluations about a small number of student characteristics. Such 
scales can be used In either a real or simulated setting or applied to 
case records as well. 

If you are concerned primarily with the presence or absence of cer- 
tain behaviors, and not the quality, then a checklist may be the most 
appropriate format* A checklist generally Includes a series of Items de- 
scribing student behaviors. Checklists are used to indicate whether 
the observer saw the student perform the Indicated action. Like the 
rating scale, the checklist can be used in both real and s imu lated 
settings. A sample Item from a checklist is given on the following page. 
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For each item listed below, check the appropriate column. 



Yes 



No 



Not Relevant 



10. Did the student expose 
the area to be 
examined? 






A checklist can be used to tally minimum competency behaviors, or fre- 
quency of behaviors. If there is a chronological sequence to the per- 
formance that will be observed, the items on the checklist should be 
arranged to parallel that order. 

One problem affecting both rating scales and checklists is that 
the behaviors the observer is being asked to rate may be an inadequate 
sampling of the observed events. The anecdotal record, which asks 
the observer to describe any positive or negative Incident, is less 

standard, but more flexible. It allows any specific focus to b« used as 
a basis for considering possible Incidents to be recorded. Instructions 

for a sample anecedotal record are given below. 



ANECDOTAL RECORD 

DIRECTIONS: You will be observing a junior medical student taking a 

patient's history. Please write a brief paragraph at the conclusion 
of your observation describing the student's performance. Comment 
specifically on the student's questlonnlng ability and interaction 
with the patient. 
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Regardless of which type of Instrument you develop and use, there are 
some general guidelines that apply. First, and most important, the instrument 
needs to be used. The people who will review the evaluations must believe 
that the ins trument and procedure is valid, and accept the outcomes as import- 
ant and reliable. An instrument is more likely to be used if it represents 
an economical use of time and energy for the observer. Very often, the 
persons who will be rating student performance will have many additional 
responsbilities, and will simply not use a form requiring a lot of time and 
pn prgy . a clearly worded form that can stand on its own without explanation 
is also more likely to be used. Brief and understandable forms usually 
require less time to train raters and are less frustrating to use. 

Each clinical evaluation instrument should be prefaced with clear 
instructions that fully explain how the form is to be used. Any potentially 
ambiguous terms should be explained or illustrated. The ins t ructions should 
describe clearly the setting in which the form is to be used, and the manner 
in which it is to be completed. There should also be an indication of how 
and by whom the results will be used. Clear instructions serve a dual 
purpose: (1) they provide a common base for all raters that may improve 

the reliability of the evaluations, and (2) they anticipate questions that 
may arise during the actual observation. 

How many characteristics (or items) should appear on a rating scale? 
Again, there is no standard answer. It is desirable that each of the 
characteristics being observed be stable, be critical to successful perfor- 
mance, and reflect intended instructional outcomes. It may be useful to 
begin the development of a rating scale by asking observers to complete 
anecdotal records with respect to their observations of former students. 

The common elements that usually appear in such records suggest traits 
that are generally viewed as critical in either a positive and negative 



0 

ERIC 



20 



sense. These traits may be used to develop rating scales or checklists. A 
clinical evaluation instrument should contain only important and critical 
characteristics, but should contain all that are relevant. There is no 
"magic" number of items or pages, but the instrument should be only as long 
as necessary. No longer. Don't ask the observer to note information that 
will not be used. 

The more clearly the behaviors to be observed are defined, the more 
reliable the evaluations are likely to be. Ambiguous terms such as "compe- 
tent" or "professional" are likely to have a different definition for each 
rater. Similarly, global evaluations' such as "good" or "fair" are difficult 
to interpret when used by a number of raters. All raters should attend to 
identical characteristics (and only those) prompted by the language you have 
used. Additionally, you would like all raters to agree on the evaluation of 
those characteristics for a given student. The more precisely terms are 
defined, the more likely you are to achieve these outcomes. It may be 
necessary to arrange for meetings among competent professionals in order 
to agree on the behaviors that are characteristic of "professional" or 
"competent" persons on the categories of Interest. 

A frequent question with respect to rating scales is, "How many cate- 
gories should there be on the scale?" Should there be 3 points on the 
numerical scale? Five points? Seven? Eleven? Again, there is no "best" 
number. There should be as many descriptive categories as there are meaningful 
differences— but no more. You should review rather carefully, however, any 
numerical scale that exceeds nine points. Are there really that many meaningful 
distinctions on the trait in question? Or will raters have a difficult time 
determining their evaluations? Such difficulty could lead to disagreement 
among raters. It is not necessary to have the same number of categories from 
item to item. If only three meaningful behavior categories emerge on one 
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characteristic and five can be identified with respect to another, those 
differences should be reflected in the number of categories on the rating 
scale. Forcing the same number of numerical points on each characteristic 
may be requiring unnecessary and unreliable distinctions. 

There are also some general problems unique to the use of rating 
scales and checklists. Raters may not properly distinguish among the 
various characteristics for a given individual, but instead allow a general 
notion of "goodness" or "badness" to Influence all ratings for a particular 
student. This tendency, sometimes called the "halo effect," introduces a 
subtle bias to the ratings and leads to a lack of validity. Some raters 
tend to give extreme ratings to every individual on every dimension-other 
raters usually mark near the center of every scale. Raters may be generous 
to a fault, perhaps thinking that criticism may hamper student motivation 
or lead to insecurity in performance. It is possible to equalize the impact 
of these unwelcome distortions by randomly assigning raters to students or 
observation segments, or to eliminate them by carefully tra inin g raters 
before the observation sessions. Part of that training period should be 
used to focus the raters' attention on each separate characteristic being 
observed and discuss the distinctions between characteristics as well as 
to clearly define each behavior category (or numerical scale point) used 
to record observations. 

SUMMARY: Development of Instruments 

Guidelines for the development of clinical evaluation instruments might 
be summarized as follows: 

1. Use the form that is most appropriate for your purpose. 

Rating scales allow the observer to make qualitative 
distinctions, whereas checklists are used to note the 
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presence or absence of behaviors. If you need to allow 


■' "A 
> 


the observer more freedom in recording observations, or 
if you have an Incomplete understanding of the behaviors 
that are critical, cm anecdotal record may provide the 
best documentation of behavior. 


2. 


Use precise, behaviorally defined terms whenever 
possible. Include clear and complete instructions 
as a part of the clinical evaluation instrument. 


3. 


Use only as many behavioral categories as are necessary 
• 

to exhaust the meaningful differences on the characteristic 
being evaluated. It is not necessary to use the same... 
number of categories for all characteristics. ..n:* 


4. 


If there is a natural order to the behaviors being 


r-J'v 


observed, parallel that order on the instrument used 
to record the observations. 


5. 


Ask the observer to attend only to those behaviors 
which are critical to successful or unsuccessful 
performance and reflect the intended outcomes of 
Instruction. 


6. 


Make the form easy to use. Be sure that the persons 
who will be using it agree that it is valid. Keep 
it brief. Make it appropriate to the setting in 
which it will be used and for the persons who will 
be using it. 


7. 


Be alert to certain tendencies of raters that may 
interfere with the validity and reliability of the 
measures. Among these tendencies are the "halo effect," 
"generosity error," and extreme or middle-of-the road 
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TRAINING RATERS AND OBSERVERS 

Raters should be clearly Informed as to the extent and nature of the 
obligation that will be required on their part. Estimate the number of 
hours to be required for training, observing, rating, and providing feed- 
back to the student or the student’s Instructor. Rater commitment Is often 
enhanced if the raters are actively Involved In the development of the 
observation forms. Raters will need training In the use of any observation 
forms. If there is no opportunity for face-to-face contact, you must rely 
completely on written directions and Instructions. Under these circum- 
stances, a brief form with the very explicit items is especially useful. 

Each instrument should include a statement of purpose and clear instruc- 
tions as to how the observations are to be recorded. The conditions under 
which the observations are to occur should be clearly described, and the 
observer should be told how the information will be used. When you have 
no opportunity to personally train raters, all guidance or training must 
be included on the form Itself. That is, generally, a rather difficult 
task! 

Suppose that you find that you can spend one hour training the raters. 
How could you most profitably use that time? A good starting point might 
be to describe the process that was followed in developing the instruments 
(in case the raters were not involved) . If raters have not been involved 
in the development you may need to persuade them that the characteristics 
being rated are Important and that their part in the rating process is 
vital. You might discuss the rationale that was followed in the selection 
of items — why particular items were included, why others were excluded. 
Providing this type of background information before looking at the details 
of the form may prevent unnecessary and time-consuming arguments later in 
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the session. Much of the time during this session should be spent 
dis cussing and clarifying definitions. The more ambiguity that can be 
eliminated, the more reliable the ratings will be. 

Should you find yourself in the enviable position of arranging a 
second meeting with the raters, you can use their comments from the initial 
set of observations as a basis to improve the forms. The experience of 
each rater in using the form will provide valuable information about unanti- 
cipated problems. 

One strategy that seems to be effective as a part of rater training 
is a practice session. The stimulus could be a videotape of actual student 
performance or a simulated situation that all raters would.be asked to 
observe and evaluate using the appropriate forms. The use of the forms 
(and attendant questions and problems) will highlight Important points for 

discussion. 

’■'.N 
.... ) 

GATHERING THE OBSERVATIONS 




Reliability is also enhanced by multiples—multiple raters and multiple 
ratings. If you can only have one or the other, it is probably preferable 
to have more than one rater evaluate each student in order to randomize 
rater tendencies that interfere with valid evaluations. If there are only 
a few available raters, urge them to make multiple ratings of each student 
at well-spaced intervals. This will reduce some of the day-to-day dis- 
tortions in rating. It will not, of course, reduce the systematic biases 
that particular raters bring to the observation setting. Urge the raters 
to do their evaluation on the spot, or at least with a minimum time lag 
between observation and recording. If ratings can not be completed at the 
observation site, encourage raters to make notes on key points in order to 
help them complete the evaluation later. Raters should be encouraged to 
exercise the option to ’’not rate 1 ’ if that is most appropriate. In some 
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Instances the raters may simply have not had sufficient opportunity to 
observe all of the characteristics contained on the instrument. Urge the 
raters to record their evaluations independently of one another. After 
you have collected all ratings, summarize the outcomes and return the 
summary to the raters to be used as a basis for further discussion about 
student performance and about the clinical evaluation procedure Itself. 



SCORING AND GRADING THE OBSERVATIONS 





Scoring should be guided by the use that will be made of the infor- 
mation resulting from observations. If the clinical evaluation form is 
being used chiefly as a source of information for improving student learning 
or faculty teaching, a score may not be necessary. A mere description or 
tally of the behaviors that are observed may be sufficient to revise instruc- 
tion or co mmuni cate results to students. 

If it is important to make decisions on an ltem-by-ltem level, as is 
frequently the case when some minimum performance level is necessary by 
the student on every trait being observed, scores on each item will pro- 
bably be sufficient. A score that compresses all these traits into a 
single summary number may obscure important Information. On the other 
hand, when a single (summative) decision about student performance must 
be made, as in the final evaluation of a students' learning, a total score 
that accurately summarizes a variety of information is necessary. If you 
must assign grades to students by ranking each student relative to all 
others in a course, a single composite number for all students will be 
needed. If a single score is necessary, then two factors should be con- 
sidered in the weighting of evaluations on each characteristic. (1) The 
weight assigned to each of the characteristics being evaluated (the sepa- 
rate items on the rating scale or checklist) , and (2) the weight to be 
given to each behavior category on the separate items. While it is not 
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Important that the numer of categories be consistent from item to item, 
it is important that the numerical range of the rating scale be consistent 
in order that veights attached to each item' be accurately reflected. The 
weighting and scoring decisions are basically numerical and psychometric 
in nature. A person familiar with measurement theory can assist in devel- 
oping scoring techniques that will suit your needs. 

More critical questions that must be addressed in order to assign 
weights and scores include, which traits are critical, to what degree, 
and how much is required for "satisfactory" achievement. These decisions 
are necessarily subjective, and should involve as many professionals as 
possible. What criteria are used? One suggestion is to try to define 
the ffl-tTHmum level of competency to which the public is entitled. Every 
student that graduates from your program should meet this standard as a 
base requirement. 


& 


Grades may be associated with the scores resulting from the use of 
clinical evaluation instruments in two ways. The first is a multiple cut- 
off method. This is preferable when there are minimum standards that are 
essential on a variety of traits. In this approach, minimum standards 
must be met on all characteristics before the student's achievement is 
certified as successful. The second method is based on the principles of 
multiple regression, where each characteristic receives some pre-specified 
weight. A high score in one area can offset low scores in other areas and 
still lead to certification. If all the competencies that are being obser- 
ved are in one general domain, then the multiple regression method may be 
very appropriate, as the specific items may be subtle variations on the 
over-all domain. On the other hand, if the items cover a variety of domains. 


kJ 


with distinct areas of Importance being represented, then the multiple cut- 
off grading method is more appropriate. 
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SUMMARY: Use of Instruments 

The following guidelines are offered for the effective use of 
clinical evaluation Instruments: 

1. Let the Information you acquire be determined by 
the use you will make of It. Evaluations conducted 
to detect specific errors or to prescribe additional 
learning activities typically require more descriptive 
Information and less numerical data. The reverse Is 
true for evaluations conducted at the conclusion of a 
course or sequence of Instruction. 

2. Train the raters! This, perhaps more than any other 
single factor, will reduce problems with the Instruments 
and Increase the reliability and validity of the evalua- 
tions. Face-to-face sessions are most desirable, but In 
their absence you may have to rely on explicit written 
Information and clear Instructions. Raters can function 
most effectively If they understand and agree with the 
principles that guided the development of the Instrument. 

3. Use a scoring scheme that reflects both the Importance 
of the traits being observed and the use that will be 
made of the data. If a single, summatlve decision 
about student performance must be made, then It will 
be necessary to derive one single composite score that 
accurately reflects all the information contained on 
the clinical evaluation Instrument. If a series of 
multiple decisions about student performance will be 
made, It may not be necessary to derive one score, 
but would be more appropriate to score each item 
separately. It may not even be necessary to score 



the Items at all, if your only concern is to provide 
the student with descriptive feedback that can be 
used to change behavior. 

A FINAL NOTE 

Conducting evaluations of clinical performance is a time-consuming 
process, but not a mystical one. You should, however, expect the process 
to be evolutionary, with many revisions required before the results will 
be acceptable. Once developed, clinical evaluation instruments and 
procedures can provide a valid and reliable source of information about 
student perfor manc e that cannot be obtained in any other manner. It is 
hoped that the suggestions offered in this paper will provide some assis- 
- tance to you in the process of develop in g clinical evaluation instruments.. 
All you have to do is to apply them in your particular setting! 
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Differences Between Criterion-Reference and 
Norm-Referenced Measures 

Here is a brief summary of some of the differences between criterion- 
referenced and norm-referenced measures. The differences are, in most cases, 
a matter of degrees. 



Factors 

1. Purpose 



2. How scores on tests 
should vary 

3. Item difficulty 

4. Type of test items 

5. Discrimination 
ability of items 

6. Types of validity 

7. Reliability 
emphasis 

8 . Problem with 
student guessing 

9. Importance of items 
that were missed 

10. Keeping items 
secure 

11. Use in education 



Criterion -Referenced 

To acquire information on 
the degree to which 
external performance 
standards (behavioral 
objectives) have been met 

Description of maximum 
performance by individuals, 
groups and treatment 
(teaching) affect 

Very little 

Tends to be easier, with 
some range 

Great variety - less 
emphasis on selection- 
type items 

Not emphasized 

Content validity 

Some concern with 
internal consistency 
because of concern 
for domain sampling 

Can affect results 



High 

Not of great concern 
Instruction 



Norm- Referenced 

To acquire information 
for relative internal 
comparisons 



Comparison of individu- 
als, especially when a 
degree of selectivity 
is needed 

A great deal 

Tend to center around 
50% item difficulty 

Some variety - but 
emphasis on selection- 
type items 

Highly emphasized 

Criterion- related 
validity 

Great concern with 
parallel forms and 
test- retest stability 

Generally not a problem 

Emphasis on number 
missed 

Great concern 



Guidance , selection, 
grading 
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WRITING MEASUREABLE OBJECTIVES 



Objectives are classified according to three domains or categories of learn 
ing: 

Cognitive - intellectual skills such as knowledge, understanding and 
thinking. 

Affective - outcomes that emphasize feeling and emotion such as inter- 
ests, attitudes, appreciation, and values. 

Psychomotor - skills that emphasize neuromuscular coordination. 

It should be noted that objectives often "involve more than one "domain, but 
one is usually dominant. 

The affective domain, while critically important, is often omitted because 
of the difficulty in stating and then measuring objectives. When the edu- 
cator values this aspect of training but doesn't specify it behaviorally , 
students can't receive the clear message, and the educator is guilty of a 
hidden agenda. Thus, writing objectives is really a communication process. 

Taxonomy of Cognitive Objectives (Bloom. 1956) 



Knowledge 



- involves recall of facts, 
principles and terms in 
the forms in which they 
are learned. 



defines , describes , identifies 
labels, lists, matches, names, 
outlines, reproduces, selects, 
states . 



Comprehension - involves the ability to 
grasp the meaning of 
such as restating 
knowledge in new terms 
and giving examples. 



converts, defends, explains, 
extends, generalizes, gives 
examples, infers, paraphrases, 
predicts, rewrites, summarizes. 



Application 



Analysis 



- involves the use of 
theory or abstractions 
in concrete situations 
such as procedures to 
be applied or theories 
to be applied. 



changes , computes , demon- 
strates, discovers manipulates, 
modifies, operates, predicts, 
prepares, produces, relates, 
shows , solves , uses . 



- involves the breaking 
down of knowledge or a 
concept into component 
parts according to 
relationships . 



breaks down, diagrams, differ- 
entiates , discriminates , dis - 
tinguishes , identifies, ill- 
ustrates, infers, outlines, 
points out, relates, selects 
separates , subdivides . 



Synthesis 



involves organizing parts 
or, elements so that they 
form new patterns, ideas, 
or structures. 



categorizes, combines, com- 
piles , composes , creates , 
devises, designs, explains, 
generates, modifies, organizes, 
plans, rearranges, recon- 
structs, relates, reorganizes, 
revises, rewrites, summarizes, 
tells, writes. 
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Evaluation 



- involves a decision or 
judgment of the value of 
knowledge, materials, and 
methods for given 
purposes . 



appraises, compares, concludes, 
contrasts, criticizes, descri- 
bes, discriminates, explains, 
justifies, interprets, relates, 
summarizes , • supports . 



Taxonomy of Affective Objectives (Krathwohl. 1964^) 



Receiving 



Responding 



Valuing 




Organization 



attends to particular 
phenomenon or stimuli. 



- voluntarily completes 
responsibilities and 
actively participates. 



shows concern for the 
worth or value of 
object, phenomenon or 
behavior. 



- develops an internally 
consistent value system. 



Characterization - demonstrates actions 

consistent by a value 
with verbalized 
values . 



asks, chooses, describes, 
follows, gives, holds, 
identifies, locates, names, 
points to, selects, sits 
erect, replies uses. 

answers, assists, complies, 
conforms, discusses, greets, 
helps, labels, performs, 
practices, presents, reads, 
recites, reports, selects, 
tells, writes. 

completes, describes, differ- 
entiates, explains, follows, 
forms, initiates, invites, 
joins, justifies, proposes, 
reads, reports, selects, 
shares, studies, works. 

adheres, alters, arranges, 
combines, compares, completes, 
defends, explains, generalizes, 
identifies, integrates, mod- 
ifies, orders, organizes, pre- 
pares, relates, synthesizes. 

acts, discriminates, displays, 
influences, listens, modifies, 
performs, practices, proposes, 
qualifies, questions, revises, 
serves, solves; uses, verifies. 



TAxonomv of Psvchomotor Objectives (Fitts. 1962) 



Cognitive 



- performs skills with errors and needs direction. 



Fixation 



- performs each sequence of a skill correctly, but 
errors in linking skills and needs feedback. 



Autonomous 




performs skill with few or no errors, with speed 
conscious thought or need for feedback. 



may make 
and without 
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or (Tuckman. 1972) 



Acquistion - perform skill correctly in a smooth pattern of operations. 

Application - automatic use of skill while consciousness is involved with 
preventing problems or experimenting with modification of 
technique . 

Integration - behavior becomes a routine part of a whole activity. 



or (Simpson. 1966) 



Perception 



- aware through sensory stimulation, cue selection, trans- 
lation. 



Set 



Guided 

Response 



- readiness for a kind of action or experience mentally, 
physically, and emotionally. 

- perform with guidance through imitation of trial and 
error. 



Mechanism 



learned response is habitual. 



Complex Overt - high degree of skill. 
Response 



Having Difficulty ? 

Some skills are visible and can be stated in terms of discrete behaviors. 
Others, especially affective ones, are less visible and no single behavior 
will indicate presence of the skill. In this case an analysis process can 
be used to describe the expected performance. To define the objective, ask 
the following questions. 

1. What will I take as evidence that the performance has been 
achieved? 

2. What is the basis for differentiating between those who achieve it 
and those who do not? 

3. What instructions would I give to tell someone how to judge 
whether the performance level has been met? 

4. Knowing persons who have achieved the performance, what is the 
evidence that they have attained it? 
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TABLE OF SPECIFICATIONS 




Table of Specification 
Sample of Pretest 
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SKILLS TEST NUMBER 19 



Test Situation 

Mrs. Jenkins is a 72 year old lady who has Alzheimers disease. You are 
assigned to give her care today. You will be evaluated on the following 
skills while doing the care: 

1. Oral Hygiene 

2. Positioning in bed 

3. Preparing her for a meals 

4. Feeding her 

3 . Communication 
6 . Hand washing 



You will demonstrate hand washing once and after that at any time you are to 
wash your hands you will communicate that you would wash your hands to the 
evaluator . 



If you have any questions, regarding what 
evaluator before you start the test. The 
after you have begun the evaluation. 



is expected of you please ask the 
evaluator will not speak to you 
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SKILLS TEST 19 SUMMARY SHEET 



Name of Candidate 

S.S. 

Skills Evaluated and Possible Points 



Skill Possible Points Points Received 

Handwashing 14 points 

Oral Hygiene 13 points 

Positioning 16 points 

Measuring Intake 05 points 

Feeding a Resident ... 17 points 

Communication 10 points 




Total 75 Points Received 



To successfully complete this skill evaluation at 70% level the candidate must 
have received 52 total points. 



Passed 



Did not Pass 



Signature of Evaluator Date 
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NURSE AIDE 
Skills Test 




Hand Washing Technique 

Equipment needed: Soap, sink, running water, paper towels, 

Name 




1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 

9 . 

10 . 

11 . 

12 . 

13 . 

14 . 



Assemble equipment . 

Turn faucet on with paper towel. 

Discard paper towel in waste basket. 

Wet hands completely. 

Apply soap. 

Hold hands lower than elbows. 

Work up a good lather. 

Clean your nails. 

Wash hands by using a rotating, rubbing motion for 
Wash at least two inches above wrist. 

Rinse well. 

Dry thoroughly with paper towels. 

Turn faucet off with paper towel. 

Discard paper towel in wastebasket. 



^Starred items must be done or its an automatic failure. 



Total Points Obtained 



Evaluators 's Signature Date 





wastebasket. 



one full minute. 
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NURSE AIDE 



Skills Test 

Assisting With Oral Hygiene 

Equipment: Toothbrush, toothpaste, emesis basin, fresh water in a cup, 

face towel (optional), mouthwash, and straw. Swabs for care 
for unconscious resident. 



Name 



1. Assemble the equipment - check label for correct name. 

2 . Wash your hands . 

3. Provide privacy for the resident. 

4. Inform resident what you will be doing. 

5. Position towel to protect resident's gown, sheets, etc.; or if 
resident is able, assist him/her to the bathroom. 

6. If facility policy requires, mix a half cup of water with half cup 
of mouthwash. 

7. Have the resident rinse his/her mouth with the mouthwash. 

8. Instruct the resident to expectorate the mouthwash into the sink or 
emesis basin you have positioned under the resident's chin. 

9. Dampen the toothbrush and assist resident to put toothpaste on the 
dampened toothbrush. 

10. If a resident is able, have him/her brush own teeth, if he/she 
can't, brush teeth for him/her.’ 

11. Have the resident rinse the toothpaste out of his/her mouth using 
the mouthwash or fresh water. 

12. Make the resident comfortable. 

13. Clean equipment and put it away. Wash your hands. 



NURSE AIDE EVALUATION 
SKILLS CHECK LIST COMMUNICATIONS 



Communication Checklist 



Name 



1 . 

2 . 

3 . 

4 . 
. 5 . 
6 . 
7 . 




8 . 

9 . 



10 . 



Comments : 



Greeted Resident by name upon entering room. 

Voice friendly - smiled. 

Introduced self. 

Answered questions correctly that resident asked. 

Explained procedure, answered questions before doing Procedures 

Asked questions of resident to make sure they understood. 

Provided time for resident to get ready for procedures .. .did not rush 
resident . 

Made resident comfortable ... checked with resident on comfort or 
do see if they wanted something else. 

Told resident they were leaving but could be contacted with 
call button. 

Generally, made resident feel comfortable throughout the procedure. 



Score Received 



Evaluator ' s Signature 



Date 




42 



NURSE AIDE 



Skill Evaluation 

Lifting and Moving a Resident in Bed 



Name 




1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 



Ask for help if necessary. 

Wash your hands . 

Insure resident's privacy. 

Tell the resident what you will be doing. 

Position pillows as taught. 

Lock wheels on bed. 

If using two aides, position each person on opposite sides of bed. 

Stand with back straight, knees bent, turned slightly toward the head 
of the bed. Feet 12 inches apart. 

Put arm under the resident's nearest shoulder. 

Put other arm under resident's buttock. 

Other assistant is doing the same. The leader will then say when to 
move. e.g. 1-2-3 pull. 

Slide resident up by straightening your knees. 

Move resident gently to prevent pain. 

Reposition comfortably. 

Wash hands . 

Report any unusual observations to supervisor. 



Instructor's Signature 



Date 




NURSE AIDE 



Skills Evaluation 
Feeding a Resident 

Equipment: Washcloth for washing resident's hands, napkin, silverware, straw, 



Name 



1 . 
2 . 
3 . 
4 *. 
5 . 




10 . 

11 . 

12 . 

13 . 

14 . 

15 . 

16 . 




17 . 

was eaten 



Tell the resident you will be helping him/her to eat. 

Wash hands . 

Offer bedpan/assist to bathroom, if able. 

Help resident wash hands. Check nails. 

Position resident comfortably at the table; or if eating in bed, 
with head elevated. If resident in chair, be sure robe and slippers 
are on. 

Remove unpleasant odors/objects. 

Check to make sure the resident has the correct diet. 

Make yourself comfortable. If you sit, you and the resident will be 
more relaxed. 

Position napkin to protect resident's clothing. Encourage resident 
to assist as much as he/she is able. 

Season food according to resident's preference. 

Fill spoon/fork only half -full . (Use the tip of the spoon not the 
side ) 

Put the food in the side of the resident's mouth. 

Alternate liquids and solids. 

Use a straw for liquids, if possible. 

Feed resident slowly. Allow him/her to chew and swallow before 
giving more food. 

Assist resident in washing face and hands. Make him/her comfort- 
able . 

Wash hands. Report anything unusual to supervisor. e.g. how much 
or comments concerning meal . 




NURSE AIDE 




Skills Checklist 
Measuring Intake 



Name 



Intake 



1. Explain to the resident that the amount of fluids he/she drinks is 
being recorded, and ask him/her to help if able. 

2. Observe all fluids the resident drinks during and between meals. 

This is done throughout the entire period in which you are working. 

3. Check the intake chart for standard amounts. Make sure the resident 
has consumed everything being recorded. 




4. 



Record everything consumed during the shift as it is consumed, be 
sure and add up the amounts after meals. These amounts should be 
recorded in c.c's. 



5. At the end of the shift, total everything consumed during the shift 
and mark total in the designated space on intake -output sheet. This 
gives an overall picture of what the resident consumed for the 8 hr. 
shift . 
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SKILLS TEST 7 



Test Situation 



Mrs. Robins is a 92 year old lady who has been in the nursing facility for 
1 year. She is confused and unsteady on her feet. You have been assigned to 
give her care. You will be evaluated on the following skills while providing 
the care. 

1. Handwashing 

2. Giving a bedpan 

3. Measuring output 

4. Oral Hygiene 

5. Restraining with a posey 



You will demonstrate handwashing once and after that at any time you are to 
wash your hands you will communicate that you would wash your hands to the 
evaluator. . 



If you have any questions, regarding what is expected of you please ask the 
evaluator before you start the test. The evaluator will not speak to you 
after you have begun the evaluation. 




SKILLS TEST 7 SUMMARY SHEET 



Name of Candidate 

S.S. 

Skills Evaluated and Possible Points 



Skill Possible Points 

Handwashing 14 points 

Oral Hygeiene 13 points 

Asst with Bedpan 21 points 

Applying Restraints . . 16 points 
Measuring Output ....10 points 

Communications 10 points 

TOTAL 84 POINTS 



Points Received 



TOTAL 



To successfully complete this skill evaluation at 70% level the testee must 
have received 59 total points. 



Passed 



Did not Pass 



Signature of Evaluator 



Date 




NURSE AIDE 
Skills Test 




Hand Washing Technique 

Equipment needed: Soap, sink, running water, paper towels, wastebasket. 



Name 

0 




1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 
9 . 

10 . 

11 . 

12 . 

13 . 

14 . 



Assemble equipment . 

Turn faucet on with paper towel. 

Discard paper towel in waste basket. 

Wet hands completely. 

Apply soap. 

Hold hands lower than elbows. 

Work up a good lather. 

Clean your nails. 

Wash hands by using a rotating, rubbing motion for one full minute. 
Wash at least two inches above wrist. 

Rinse well. 

Dry thoroughly with paper towels. 

Turn faucet off with paper towel. 

Discard paper towel in wastebasket. 



■^Starred items must be done or its an automatic failure. 



Total Points Obtained 



Evaluators ' s Signature 





Date 



NURSE AIDE EVALUATION 
SKILLS CHECK LIST COMMUNICATIONS 



Communication Checklist 



Name 



1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 




8 . 

9 . 



10 . 



Comments : 



Greeted Resident by name upon entering room. 

Voice friendly - smiled. 

Introduced self. 

Answered questions correctly that resident asked. 

Explained procedure, answered questions before doing Procedures 

Asked questions of resident to make sure they understood. 

Provided time for resident to get ready for procedures ... did not rush 
resident . 

Made resident comfortable ... checked with resident on comfort or 
do see if they wanted something else. 

Told resident they were leaving but could be contacted with 
call button. 

Generally, made resident feel comfortable throughout the procedure. 



Score Received 



Evaluator ' s Signature 



Date 





NURSE AIDE 



Skills Test 

Assisting With Oral Hygiene 



Equipment : 
Name 


Toothbrush, toothpaste, emesis basin, fresh water in a cup, 
face towel (optional), mouthwash, and straw. Swabs for care 
for unconscious resident. 


i. 


Assemble the equipment - check label for correct name . 


2. 


Wash your hands . 


3. 


Provide privacy for the resident. 


4. 


Inform resident what you will be doing. 


5. 


Position towel to protect resident's gown, sheets, etc.; or if 
resident is able, assist him/her to the bathroom. 


6. 


If facility policy requires, mix a half cup of water with half cup 
of mouthwash . 


7. 


Have the resident rinse his/her mouth with the mouthwash. 


8. 


Instruct the resident to expectorate the mouthwash into the sink or 
emesis basin you have positioned under the resident's chin. 


9. 


Dampen the toothbrush and assist resident to put toothpaste on the 
dampened toothbrush. 


10. 


If a resident is able, have him/her brush own teeth, if he/she 
can't, brush teeth for him/her. 


11. 


Have the resident rinse the toothpaste out of his/her mouth using 
the mouthwash or fresh water. 


12. 


Make the resident comfortable. 


13. 


Clean equipment and put it away. Wash your hands. 



NURSE AIDE EVALUATION 



Skills Checklist 



Measuring Output 



1. Explain to the resident that you will be measuring the amount of 
urine he/she is putting out, and explain he/she must use urinal or 
bedpan. A special bedpan should be used if resident is also having 
a bowel movement . 



2. Instruct the resident not to put toilet tissue in the bedpan. 

4. After the resident has urinated, pour urine from urinal or bedpan 
into the graduate for measuring urine . 



5. Read the amount of urine by using the graduated lines on the 
container . 




6 . 



Observe urine for unusual appearance. Report if noted. 



7. Empty urinal or bedpan, rinse and return to proper place. Take the 
toilet tissue from wastebasket and put in stool and flush stool. 



8 . Wash hands . 

9. Record the amount of the output on the intake/output sheet in c.c's. 

10. Total the entire amount of output at the end of the shift when you 
total the input, and report/record as required by your facility. 



O 

ERIC 
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NURSE AIDE 



Skills Evaluation 

Assisting the Resident with A Bedpan 

Equipment: Bedpan, bedpan cover, tissue, water or wet washcloth, towel. 

Name 



BEDPAN 



1 . 

2 . 

3 . 

4 . 

5 . 

6 . 
7 . 



8 . 



9 . 

10 . 

11 . 

12 . 

13 . 

14 . 

15 . 



Assemble equipment . 

Wash hands . 

Provide privacy. Explain what you are going to do. 

If bedpan is metal, warm the bedpan by running warm water over. Dry 
the outside of the bed pan. 

Lower siderails, fold back the top sheets if they are in the way. 
Raise the resident's gown. 

Ask the resident to bend his/her knees; put feel flat on the 
mattress; and raise hips by pressing feet down on the bed. If 
necessary, help the resident raise his/her buttocks by slipping your 
hand under the lower part of the back. Place the bedpan in position 
under the buttocks . 

If resident unable to lift buttocks; then turn resident to his/her 
side away from you. Position bedpan over buttock. Turn resident 
onto his/her toward you, bedpan will be in correct position. 

Replace covers over resident. 

Raise the backrest and knees, (if allowed). Resident should be in as 
much of a sitting position as possible. 

Place toilet tissue and signal cord where resident can easily reach 
them. Ask resident to signal when finished. 

Place side rails in up position. 

Wash hands and leave room to give resident privacy. Watch for the 
signal light. 

After a short time or when resident signals, return to room. Help 
the resident to raise hips and remove bedpan. 

Cover the bedpan immediately. 



Turn Page 




52 



16 . 



If resident unable to clean self, help him/her by turning resident 
on side and clean with toilet tissue or damp cloth. 



17. Take bedpan to resident's bathroom. If resident is on intake, 
measure urine. Check feces, urine for unusual appearance. 



18. Empty the bedpan and follow the facility's procedure for cleaning 
the bedpan . 

19. Return bedpan to bedside stand. 

20. Help resident wash his/her hands, and position comfortably. 

21. Wash hands. Report any unusual observations to the supervisor. 
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NURSE AIDE 



Skills Evaluation 
Safely Applying Restraints 



Equipment : 
Name 



Restraints that have been approved by nurse, pads as required. 




1. Check with nurse regarding order and type of restraint to be applied 

2. Assemble equipment. 

3 . Wash hands . 

4. Determine if help is needed in applying restraints; if it is, get 
help. 

5. If appropriate take the resident to the bathroom before applying. 

6. Calmly explain to the resident what you are going to do. 

7. Properly and comfortably position resident. 

8. Pad any bony prominences. 

9. Follow the correct procedure for the type of restraint being applied 

10. Be sure restraints are secured in proper places; not to side rails 
but to the frame of the bed. 

11. Check to make sure restraints but to the frame of the bed. 

| 

12. Check to make sure restraints are not too tight-check circulation. 

13. Leave resident as comfortable as possible. 

14 . Wash hands . 

15. Record, if required by your facility. ‘ 

16. Check restraints as often as required and remove as required. 
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